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Abstract 

The rationalizability concept was introduced in Bernheim [1984] and 
Pearce [1984] to assess what can be inferred by rational players in a 
non-cooperative game in the presence of common knowledge. However, 
this notion can be defined in a number of ways that differ in seemingly 
unimportant minor details. We shed light on these differences, explain 
their impact, and clarify for which games these definitions coincide. 

Then we apply the same analysis to explain the differences and sim- 
ilarities between various ways the iterated elimination of strictly domi- 
nated strategies was defined in the literature. This allows us to clarify 
the results of Dufwenberg and Stegeman [2002] and Chen, Long and 
Luo [2005] and improve upon them. We also consider the extension of 
these results to strict dominance by a mixed strategy. 

Our approach is based on a general study of the operators on com- 
plete lattices. We allow transfinite iterations of the considered operators 
and clarify the need for them. The advantage of such a general approach 
is that a number of results, including order independence for some of 
the notions of rationalizability and strict dominance, come for free. 

1 Introduction 
1.1 Motivation 

Rationalizability was introduced in Bernheim [1984] and Pearce [1984] to for- 
malize the intuition that players in non-cooperatives games act by having 
common knowledge of each others' rational behaviour. Rationalizable strate- 
gies are then defined as a limit of an iterative process in which one repeatedly 
removes the strategies that are never best responses to the beliefs held about 
the other players. 



To better understand the rationale for the research here reported consider 
the following example. 

Example 1 Bertrand competition. 

Consider a version of Bertrand competition between two firms in which the 
marginal costs are and in which the range of possible prices is the left-open 
real interval (0, 100]. So in this game H there are two players, each with the 
set (0, 100] of strategies. We assume that the demand equals 100 — p, where p 
is the lower price and that the profits are split in case of a tie. So the payoff 
functions are defined by: 
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This game has no Nash equilibrium (in pure strategies). 

Consider now each player's best responses to the strategies of the opponent. 
Since si = 50 maximizes the value of Si(100 — Si) in the interval (0, 100], the 
strategy 50 is the unique best response of the first player to any strategy 
S2 > 50 of the second player. Further, no strategy is a best response to a 
strategy S2 < 50. By symmetry the same holds for the strategies of the second 
player. 

This eliminates for each player each strategy different than 50 and reduces 
the original game to the game G := ({50}, {50},pi,p2) in which each player 
has just one strategy, 50. 

There are now two natural ways to proceed. If we adopt the approach 
of Pearce [1984], we should now focus on the current game G and note that 
Si = 50 is a best response in G to S2 = 50 and symmetrically for the second 
player. So the iterated elimination of never best responses stops and the 
outcome is G. 

However, if we adopt the approach of Bernheim [1984], we should continue 
to consider the best responses in the original game H. Now in H the strategy 
Si = 49 is a better response to S2 = 50 than si = 50 and symmetrically for the 
second player. So in the second round of elimination of never best responses 
both strategies 50 are eliminated and we reach the empty game. 
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So depending on the procedure we adopt we obtain two different outcomes. 

□ 



We shall return to this example in Section 5. We shall show there that 
using the first elimination procedure we can still reach the empty game, if in 
each round only some strategies are removed. This might suggest that both 
approaches are equivalent if we do not insist on removing all strategies in each 
round (analogously to the case of iterated elimination of strictly dominated 
strategies). However, as we shall see, this statement is false. 

So we see that the iterated elimination of best responses process can be 
defined in two different ways. In fact, two other definitions can be naturally 
envisaged. Each of these four definitions captures the original intuition in a 
meaningful way. Indeed, all four operators upon which these definitions rely 
yield the same outcome when applied to the original game. The differences 
arise when these operators are iterated. 

Let us move now to the case of strict dominance. Consider the following 
example. 

Example 2 Production with a discontinuity. 

Consider a game H with two players, each, as in the previous example with 
the set (0, 100] of strategies. The payoff functions are defined now by: 



where each function is strictly increasing in the ith argument. (A simple 
example is fi{si,S2) ■= Sj.) 

A possible interpretation of this game is as follows. The strategy of a player 
represents the amount of his resource that he chooses. If each player 'overdoes 
it' and chooses the maximum amount, the outcome is bad (0) for both of them. 
Otherwise each player gets the outcome computed by his production function 
fi. Also this game has no Nash equilibrium. 

Consider now each player's strategies that are not strictly dominated. 
Clearly every strategy Sj 7^ 100 is strictly dominated and 100 is not strictly 
dominated. By eliminating all strictly dominated strategies the original game 
reduces to the game G := ({100}, {100},pi,p2) in which each player has just 
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one strategy, 100. The payoff for each player to the joint strategy (100, 100) 
is 0. 

Again, there are two natural ways to proceed. If we take the usual ap- 
proach, adopted in numerous publications, we should focus on the current 
game, G. Since this game is solved (i.e., each player has just one strategy) 
the iterated elimination of strictly dominated strategies, in short lESDS, stops 
and the outcome is G. 

However, if we adopt the approach of Milgrom and Roberts [1990, pages 
1264-1265], we should continue and consider which strategies in the game G 
are strictly dominated (against the opponent strategies in G) in the original 
game H. Now, for each player i each strategy 100 is strictly dominated by any 
other strategy Sj in the game H as each Sj yields a strictly higher payoff against 
the strategy 100 of the opponent. So in the second round of elimination of 
strictly dominated strategies both strategies 100 are eliminated and we reach 
the empty game. 

So also here, depending on the procedure we adopt we obtain two different 
outcomes. (A perceptive reader may notice that the elimination of never best 
responses also reduces the original game to ({100}, {100},pi,p2) and that in 
the original game for each player each strategy 7^ 100 is a better response to 
100 than 100. So also here the outcome of the iterated elimination of never 
best responses depends on the adopted procedure.) □ 

In fact, we show that also lESDS can be defined in four natural ways and 
that the resulting outcomes differ. 

1.2 Approach and summary of results 

To analyze in a uniform way various ways of iterated elimination of strategies 
here considered we consider arbitary operators on complete lattices and their 
transfinite iterations. This allows us to prove various results concerning the 
rationalizability and lESDS by simply checking the properties of underlying 
operators. For example, order independence for specific definitions turns out to 
be a direct consequence of the fact that the underlying operator is monotonic. 

Before we proceed let us clarify two, rather unusual aspects of our approach. 
First, the use of transfinite induction and ordinals in reasoning about games is 
rare though not uncommon. The following illustrative examples come to our 
mind. In Binmore [2007, Chapter 7] (and implicitly in the original version, 
Binmore [1991]) a proof, attributed to G. Owen, of the Minimax Theorem is 
given that is based on transfinite induction. Next, in Lipman [1991] transfinite 
ordinals are used in a study of limited rationality, while in Lipman [1994] a 
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two-player game is constructed for which the uo (the first infinite ordinal) and 
u) + l iterations of the rationalizability operator of Bernheim [1984] differ. That 
is, uj iterations are insufficient to reach a fixpoint. This motivates the author 
to study transfinite iterations of this operator. We shall return to this matter 
in Section 4. In turn, Heifetz and Samet [1998] show that in general arbitrary 
ordinals are necessary in the epistemic analysis of strategic games based on 
the partition spaces. Finally, as argued in Chen, Long and Luo [2005], the 
notion of lESDS a la Milgrom and Roberts [1990], when used for arbitrary 
games, also requires transfinite iterations of the underlying operator. 

The mathematical reason for the use of transfinite induction is that the 
underlying operators, even if they are monotonic, are in general not continuous. 
So to reach a fixpoint, by the theorem of Tarski [1955] (which generalizes and 
strengthens the initial result of Knaster [1928]), one needs to consider iterations 
that continue beyond uj. 

Second, we consider solution concepts based on the iterated elimination of 
strategies that can yield the empty outcomes. This is inherent in the nature of 
infinite games as it can then easily happen that no strategy is a best response or 
that each strategy is strictly dominated. The empty outcome only indicates 
that in some games the players have no rational strategy to choose from. 
Analogous problems arise if one adopts as a solution concept the set of Nash 
equilibria of a non-cooperative game or the core of a cooperative game. In 
both cases these sets can be empty. To quote from Aumann [1985]: 

My main thesis is that a solution concept should be judged more by 
what it does than by what it is; more by its success in establishing 
relationships and providing insights into the workings of the social 
processes to which it is applied than by considerations of a a priori 
plausibility based on its definition alone. 

Our analysis allows us to conclude that in the case of arbitrary games 
among four ways of defining rationalizability only two, the one due Bern- 
heim [1984] and its contracting version (a notion explained in Section 3), are 
meaningful. The crucial feature of these two operators is that they refer to 
the best responses in the initial game and not the currently considered game. 
As a result these two operators are monotonic. However, under the assump- 
tion that to each belief in the initial game a best response exists (assumption 
B), the iterations of all four operators coincide even though the other two 
still are not monotonic. We also explain the need for transfinite iterations of 
the corresponding operators, even for the games that satisfy assumption B. 
Assumption B is in particular satisfied by the compact games with contin- 
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uous payoff functions, which explains why the reported differences were not 
discussed in the hterature. 

We also apply the same analysis to the notion of strict dominance. We 
explain that the operator underlying the usual definiton is not monotonic. 
This clarifies why this definition of strict dominance is not order independent 
for arbitrary infinite games (see Dufwenberg and Stegeman [2002]). 

In contrast, the version of the iterated elimination of strictly dominated 
strategies used in Milgrom and Roberts [1990] and more recently in Ritzberger 
[2001, Section 5.1] is monotonic. The contracting version of it studied in Chen, 
Long and Luo [2005] . The authors of the latter paper show that the resulting 
elimination procedure is stronger than the customary one, requires transfinite 
iterations, does not remove any Nash equilibria, and is order independent. In 
our framework order independence of both versions is a direct consequence of 
the monotonicity of the underlying operators. 

We also consider a natural condition C{a) of the initial game, parametrized 
by an ordinal a, that formalizes the statement that in each reduction reachable 
from the initial game in a iterations every strictly dominated strategy has an 
undominated dominator. We show that VaC(a) implies order independence 
of the usual definition of strict dominance. Further, VaC(a) implies that the 
iterations of all four considered operators coincide. Assumption \/aC{a) is in 
particular satisfied by the finite games. 

Our formalization of the condition C{a) differs from the one used in Dufwen- 
berg and Stegeman [2002] for which the authors showed that the iterated 
elimination of strictly dominated strategies may fail to be order independent 
in their sense. (Our definitions of order independence differ, since we allow 
transfinite iterations of the underlying operators.) We show that C{uj) implies 
order independence, in the sense used in Dufwenberg and Stegeman [2002] , of 
strict dominance. This yields a minor improvement of their result. Finally, 
we explain how to extend these results to the case of iterated elimination of 
strictly dominated strategies by a mixed strategy. 

1.3 Plan of the paper 

The paper is organized as follows. Standard concepts on strategic games and 
examples of belief structures to which the results of this paper apply are intro- 
duced in Section 2. Next, in Section 3 some general results about monotonic 
and contracting operators on complete lattices are established that provide a 
basis for our approach. 

In Section 4 we discuss two operators that underly the definitions of ratio- 
nalizability, including the one due to Bernheim [1984]. Both are monotonic. 
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so the revelant properties of these operators and of their outcomes are direct 
consequences of the general results established in Section 3. 

Then in Section 5 we discuss two slightly different operators defining a no- 
tion of rationalizability. We conclude that one of them cannot be meaningfully 
used to formalize the notion of rationalizability and the other one, underly- 
ing the definition of rationalizability due to Pearce [1984], leads to too weak 
conclusions for a game modelling Bertrand competition for two firms. On the 
other hand, in Section 6 we show that the best response property in the initial 
game implies that the iterations of all four operators coincide. 

Then in Sections 7 and 8 we discuss in detail four natural ways of defining 
iterated elimination of strictly dominated strategies and analyze when the it- 
erations of the corresponding four operators coincide. In Section 9 we compare 
our results with those of Dufwenberg and Stegeman [2002] and clarify in what 
sense we established a new order independence result. 

Next, in Section 10 consider an extension of these results to the case of 
strict dominance by a mixed strategy. Finally, in Section 11 we assess the 
results of this paper stressing that monotonicity and transfinite iterations are 
most relevant for a study of reduction operators on games. 

In the literature we found only one reference concerned with a similar 
comparative analysis of the notion of rationalizability. Ambroszkiewicz [1994] 
studied the limited case of two-player games and beliefs being equal to the 
strategies of the opponent, and showed that the finite iterations of two opera- 
tors concerned with the notion of rationalizablity coincide for compact games 
with continuous payoffs. We clarify his result in Section 6. 

Parts of this research were reported in Apt [2005]. 

2 Game theoretic preliminaries 

2.1 Strategic games and their restrictions 

Let us move now to the subject of strategic games. Given n players {n > 1) 
we represent a strategic game (in short, a game) by a sequence 

{Si,...,Sn,Pl,...,Pn), 

where for each i G [l..n] 

• Si is the non-empty set of strategies available to player i, 

• Pi is the payoff function for the player i, so Pi : 5*1 x . . . x S'„ — ^ 7^, 
where TZ is the set of real numbers. 
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Given a sequence of sets of strategies Si, . . Sn and s G iSi x . . . x S'„ we 
denote the ith element of s by Sj and use the following standard notation: 

• S—i . ("Sl; • • •) 'Sj—l, . . ., Sji), 

• S^i := Si X . . . X Si^i X Si+i X . . . X Sn- 

We denote the strategies of player i by Sj, possibly with some superscripts. 

We say that G := {Si, . . ., Sn) is a restriction of a game H := (Ti, . . ., Tn, 
Pi, . . .,pn) if each Si is a (possibly empty) subset of Tj. We identify the re- 
striction (Ti, . . .,Tn) with The restrictions are naturally ordered by the 
componentwise set inclusion: 

{Si,.. ., Sn) C{S[,..., S'J iff S, C Si for all z G [1..^]. 

If some is empty, {Si, . . ., Sn,Pi, ■ ■ -jPn (we identify here each pi with its 
restriction to the smaller domain) is not a game and the references to Pj{s) 
(for any j G [1 ••'"-]) are incorrect, so we shall need to be careful about this. If 
all Si are empty, we call G an empty restriction. 

2.2 Belief structures 

Throughout the paper H := (Ti, . . .,Tn,Pi, . . .,Pn) is a fixed game. 

Our intention is to explain various concepts of rationalizability abstracting 
from specific sets of beliefs that are assumed. Therefore we only assume that 
each player i in the game H has some further unspecified non-empty set of 
beliefs Bi about his opponents and that each payoff function pi can be modified 
to an expected payoff function pi : Si x Bi ^ TZ. 

In what follows we also assume that each set of beliefs Bi of player i in H 
can be narrowed to any restriction G of H. We denote the outcome of this 
narrowing of Bi to G by h G. The set Bi H G can be viewed as the set 
of beliefs of player i in the restriction G. We call then the pair {B, fi), where 
B := {Bi, . . ., Bn), a belief structure in the game H. 

The following natural property of a belief structure {B, fl) in H will be 
relevant. 

A If Gi C G2 C H, then for all i G BiOGiC B, n G2. 

This property simply states that for each player the set of his beliefs in a 
restriction Gi of G2 is a subset of the set of his beliefs in 
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The following four belief structures were considered in the literature. Given 
a finite non-empty set A we denote here by AA the set of probability distri- 
butions over A and by A°A the set of probability distributions over A that 
assign a positive probability to each element of A. 

(i) Bi := T_i for i E [l..n]. 

So beliefs are joint pure strategies of the opponents (usually called point 
beliefs). For a restriction G := {Si, . . ., S'„) of H we define 

i3, n G := S_i. 

We call then {B, fl) the pure belief structure in H. This belief structure 
was considered in Bernheim [1984]. 

A specific case with a different definition of fl was considered in Pearce 
[1984]. In that paper if is a mixed extension of a finite game. So 
given initial finite sets of strategies /i, . . ., each set Tj equals A/j, i.e., 
H := (All, . . ., AIn,Pi, . . -yPn)- Then for a restriction G := (^i, . . ., Sn) 
oiH 

Bi n G := Uj^iSj, 

where for a set Sj of mixed strategies of player j, Sj denotes its convex 
hull. 

(ii) Assume H is finite. Bi := Uj^iATj for i G [l..n]. 

So beliefs are joint mixed strategies of the opponents. For a restriction 
G := {Si, . . ., Sn) of H we define 

BinG:= Uj^iASj. 
This belief structure was considered in Bernheim [1984]. 

(iii) Assume H is finite. Bi := AT_j for i G [L.n]. 

So beliefs are probability distributions over the set of joint pure strategies 
of the opponents (usually called correlated mixed strategies). For a 
restriction G := {Si, . . ., Sn) of H we define 

B^r\G:= AS-i. 
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This belief structure was mentioned in Bernheim [1984] and studied in 
Brandenburger and Dekel [1987], where the term correlated rational- 
izability was introduced. 

(iv) Assume H is finite. Bi := Ilj^iA°Tj for i G [l..n]. 

So behefs are joint totally mixed strategies of the opponents. For a 
restriction G := {Si, . . ., Sn) of H we define 

i3i n G := Ilj^iA°Sj. 

This behef structure was studied in Pearce [1984] , where a best response 
to a behef formed by a joint totahy mixed strategy of the opponents is 
caUed a cautious response. 

Given two finite sets A and B such that A(l B, we identify each proba- 
bihty distribution on A with the probabihty distribution on B in which is 
assigned to each element in B\A. Then A(l B implies A A C AB. It is now 
straightforward to see that property A is satisfied by the belief structures from 
examples (i) — (iii). So by appropriately choosing the belief structure {B,n) 
we shall be able to apply our results to a variety of frameworks including the 
ones considered in Bernheim [1984] and Pearce [1984]. 

It is important, however, to note that property A is not satisfied by the 
belief structure from example (iv). The reason is that for finite sets A and B 
such that A(l B the inclusion A°A C A°B does not hold. So the results of our 
paper do not apply to the modifications of the notion of rationalizability that 
rely on totally mixed strategies, for example Herings and Vannetelbosch [2000], 
where the notion of weak perfect rationalizability is studied.^ 

3 Operators on complete lattices 

We are interested in iterated reductions of strategic games entailed by various 
ways of removing strategies. To deal with them in a uniform way we define the 
relevant concepts for arbitrary operators on a fixed complete lattice {D, C ) 
with the largest element T. 

^This is not surprising since by the result of Pearce [1984] the notions of rationahzabihty 
w.r.t. totally mixed strategies of the opponent and of not being weakly dominated by a 
mixed strategy coincide in two-player finite games and, as is well-known, the latter notion 
fails to be order independent. 
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In what follows we use ordinals and denote them by a, /9, 7. Given a, 
possibly transfinite, sequence (Gq,)q,<^ of elements of D we denote their join 
and meet respectively by |J„<^ and Hc^^ G^. 

In the subsequent applications D will be the set of all restrictions of a fixed 
strategic game H for n players, ordered by the componentwise set inclusion C 
(so H is the largest element) and IJq:<7 ^^"^ na<7 customary set-theoretic 
operations on them. But this additional information on the structure of D 
will be irrelevant in the remainder of this section. 

We now establish some general results on operators on complete lattices. 
The proofs are straightforward and the results readily apply to the operators 
we shall subsequently study. 

Definition 1 Let T be an operator on (D, C ), i.e., T : D ^ D. 

• We say that an element G is a fixpoint of T if T{G) = G. 

• We call T monotonic if for all Gi , G2 

Gi C G2 implies T{Gi) C T{G2). 

• We call T contracting if for all G 

T{G) C G. 

• We define the contracting version of T by: 

T{G) ■= T{G) n G. 

• We define by transfinite induction a sequence of elements of D, where 
a is an ordinal, as follows: 

- := T, 

— for all limit ordinals := Hck/j^"- 

• We call the least a such that T"+^ = T" the closure ordinal of T and 
denote it by a-r- We call then T"^ the outcome of (iterating) T. □ 



11 



The outcome of an operator can be the least element of the complete lattice. 
So in the case of the complete lattice of the restrictions of H ordered by the 
componentwise set inclusion C the outcome can be an empty restriction. In 
general the closure ordinal of T, and hence its outcome, do not need to exist. 
(Take for example an operator oscillating between two values.) However, we 
have the following classic result due to Tarski [1955].^ 

Tarski's Fixpoint Theorem Every monotonic operator on (D, C ) has a 
largest fixpoint. This fixpoint is the outcome of T, i.e., it is of the form T'^t _ 

Clearly, if T is monotonic, then so is T. Other observations concerning the 
above notions are gathered in the following note. 

Note 1 Consider an operator T on {D, C ). 

(i) IfT is contracting or monotonic, then T""*"^ C for all a. 
(a) Suppose that T°+^ C T° for all a. Then 

• T = T° for all a, 

• the outcomes ofT and T exist and coincide. 

Proof. The existence of the outcome of T under the assumption of (ii) follows 
by the standard arguments of set theory (see, e.g., Aczel [1977]). The other 
claims follow by transfinite induction. □ 

So if we are only interested in the operator iterations or its outcome, it does 
not matter whether we choose an operator T that is contracting or monotonic, 
or its contracting version T. 

In what follows we shall frequently use the following lemma. 

Lemma 1 Consider two operators T and R on {D, C ) such that 

• for alia, T(/2") C i?(i?"), 

• T is monotonic. 
Then for all a 

In particular if R has an outcome, then C R"''^ . 

^We use here its 'dual' version in which the iterations start at the largest and not at the 
least element of a complete lattice. 
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Proof. We prove the first claim by transfinite induction. By the definition 
of the iterations we only need to consider the induction step for a successor 
ordinal. So suppose the claim holds for some a. Then by the first two assump- 
tions and the induction hypothesis we have the following string of inclusions 
and equalities: 

By Tarski's Fixpoint Theorem T has an outcome, so the second claim 
follows immediately from the first. □ 

We now formalize the idea that a procedure of iterated elimination of strate- 
gies is order independent. Interestingly, it is possible to state this property 
without specializing the underlying complete lattice to that of all restrictions 
of the initial game, by simply focusing on iterations of operators. The defini- 
tion we provide also takes care of the possibility that the elimination process 
takes more than u iteration steps. 

Definition 2 Consider a contracting operator T ('T removes strategies') on 
(D, C ). We say that T is order independent if 

('the outcomes of the iterated eliminations of strategies coincide') for each 
operator R such that for all a 

• T(/?") C i?(i?°) C i?" 

('i? removes from only strategies that T removes') 

• if T(i?°) C i?", then i?(i?°) C 

('if T can remove some strategies from i?", then R as well'). 

(Note that exists by Note 1.) □ 

The intuitions provided in the brackets hopefully make this definition self- 
explanatory. This definition is perfectly satisfactory as long as we consider 
procedures that remove strategies. However, we shall consider here arbitrary 
procedures on games and sometimes they may add strategies. To deal with 
this more general setting we introduce a definition of order independence for 
arbitrary operators. 

Definition 3 Consider an operator T on (D, C ). 
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• We say that the operator i? is a relaxation of T if for all a 

- if T(/?") C then C 

— if i?" is a fixpoint of i?, then it is a fixpoint of T. 

• We say that T is order independent if the set 

{G I G is an outcome of a relaxation of T} 

has at most one element. □ 

The intuition behind the conditions defining a relaxation is as follows. 
Suppose that T is a procedure on the set of restrictions of the initial game. 
Then the first condition states that during the iterations of R (i.e., for all 
restrictions -R°) the operator R 'approximates' T from above. In turn, the 
second condition states that if T removes some strategies from some restriction 
i?", then so does R. Finally, the third condition states that if some strategy 
can be removed from/added to some restriction by the operator T (i?" 
is not a fixpoint of T), then the same holds for the R operator is not a 
fixpoint of R). 

Note that this definition of order independence of an operator T does not 
even require that T has an outcome. If it does have, then each relaxation of 
it has the same outcome as T, if it has one. 

The following observation shows that the second definition generalizes the 
first one. 

Note 2 For a contracting operator T on {D, C ) both definitions of order 
independence coincide. 

Proof. For a contracting operator T the first two conditions of the definition of 
a relaxation R are equivalent to the first condition on R in Definition 2, while 
the third condition is equivalent to the second condition on R in Definition 2. 

Moreover, for all relaxations i? of T we have R°'~^^ C i?" for all a and hence, 
by Note 1, they all have an outcome. Also T is a relaxation of itself, so order 
independence in the sense of Definition 3 is equivalent to the statement that 
j^aR _ rpaT j^olds for all relaxations R oiT. □ 

From now on when referring to order independence we shall mean the latter 
definition. The following general result holds. 



14 



Theorem 1 (Order Independence) Every monotonic operator on (D, C ) 
is order independent. 

Proof. Let T be a monotonic operator. By Tarski's Fixpoint Theorem T has 
an outcome, T°^, which is the largest fixpoint of T. To prove the theorem it 
suffices to show that 

{G I G is an outcome of a relaxation of T} = {T"^}. 

So take a relaxation R oi T that has an outcome, i?"^. By Lemma 1 
rpar ^ But by the definition of a relaxation R^^ is a fixpoint of T and 

is the largest fixpoint of T, so also i?"^ C t°'t _ Consequently R^^ = T^'t _ 

□ 

Intuitively, this result can be interpreted as follows. Suppose that an op- 
erator T removes all strategies from a restriction of a game H that meet some 
property and that we iterate this operator starting with H. Suppose now that 
at each stage we remove only some strategies that meet this property (instead 
of all). Then, when T is monotonic, we still end up with the same outcome 
(which is the largest fixpoint of the T operator). 

Note that we did not assume here that the operator T is contracting and 
consequently had to rely on the second definition of order independence. Also, 
in the proof we did not use the second condition of the definition of a relaxation. 
In our approach this condition is needed only to deal with the contracting 
operators that are not monotonic. 



4 The GR and GR operators 

We now apply the above considerations to specific operators. Each of them is 
defined in the context of a fixed game H and a belief structure {B, fl) in H. 

Given a restriction G := {Si, . . ., S'„) of H and a belief /i, G i3j fi G we say 
that a strategy Sj of player i in the game H is a. best response to fii in G, 
and write Sj G BRdfii), if 

Vs- G Si pi{si, fii) > pi{s[, fii). 

Note that Si does not need to be an element of Si. 

We now introduce the following operator GR (standing for 'global ratio- 
nalizability') on the set of restrictions of H: 

GR{G) ■.= {S[,...,S'J, 
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where for all i G [l..n] 



Si := {si eT,\3^,eB,nGs,e BRniiJii)]. 



So GR{G) is obtained by removing from H all strategies that are never 
best responses in H (note this reference to H) to a belief held in G. That is, 
when removing the strategies we allow justifications (for their removal) from 
the initial game H. 

Thanks to property A the operator GR is monotonic. So we can apply 
to GR and its contracting version GR Note 1 and as a result we can confine 
further analysis to the latter operator. The GR operator was considered in 
Bernheim [1984] (called there A, see page 1015).^ On the account of the results 
from the previous section the GR operator enjoys various properties. We list 
them as the following result. 

Theorem 2 (GR) 

(i) The largest fixpoint of GR exists and is its outcome, 
(a) GR is order independent. 

(Hi) For all relaxations R of GR and all a we haveGR C i?". □ 

In general, infinite iterations of GR can be necessary. In fact, in some 
games u iterations of GR are insufficient to reach the outcome, that is, the 
closure ordinal of GR can be larger than u. 

Example 3 Consider the following game H with two players. The set of 
strategies for each player is the set of natural numbers A/" augmented by —1. 
The payoff functions are defined as follows. For k,i>0 we put: 



For the remaining pairs of strategies we put for k,i > —1 and ^o, ^ 0: 



■^The reader may now notice that in Example 1 we used the GR operator instead of GR, 
which is more comphcated to justify informally. 




£ + 1 iik = i + l 
otherwise 




Pi{-l,i) :=£ + ! 
Pi{ko, -1) := ko, 
P2{k, -1) := k, 
P2{-l,io) ■=io. 
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Further we assume the pure behef structure, i.e., the behefs are the strate- 
gies of the opponent. The following two diagrams explain the structure of this 
game. In each of them on the left we depict strategies of player 1 and on the 
right the strategies of player 2. An arrow from a to 6 stands for the statement 
'strategy a is a best response to strategy b\ In particular, no arrow leaves 
strategy of player 1, which indicates that it is not a best response to any 
strategy of player 2. 





Note that 

• each —1 is a best response to any non- negative strategy, 

• no best response to any —1 strategy exists, 

• the best response to strategy A; > of player 1 is k, 

• the best response to strategy ^ > of player 2 is £ + 1. 
Denote A/" U { — 1} by A/"'. It is easy to see that 

= (AT', AT'), 

gr' = i^^'\{o},^^'), 

GR' = {Af'\{0},Af'\{0}), 
Gr' = {M'\ {0,1}, M'\{0}), 
Gr' = {M'\ {0,1}, Af'\ {0,1}), 



So GR^ = ({ — !}, { — !}). But in the initial game no —1 is a best response 
to 'the other' -1. So GR{{{-1}, {-!})) = (0, 0), that is GT^^ = (0, 0). □ 

As already mentioned in Section 1, in Lipman [1994] a two-player game is 
constructed for which a; iterations of GR are insufficient to reach the outcome. 
In this example each set of beliefs Bi consists of the mixed strategies of the 
opponent and the game is considerably more complex. 
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5 The LR and LR operators 

In this section we analyze the following operator LR (standing for 'local ratio- 
nalizability') on the set of restrictions of H: 

LR{G) := {S[, . . ., S'n), 

where for all i G [l..n] 

5; := {si eT,\3fiieB,nGs,e BRdiXi)}. 

So LR{G) is obtained by removing from H all strategies that are never best 
responses in G (so not in H) to a belief held in G. That is, when removing 
strategies we use justifications (for their removal) from the currently considered 
game G. For each restriction G of H, Si G BRniHi) implies Si G BRc{fJ.i), so 
for all restrictions G we have GR{G) C LR{G). 

Unfortunately, the LR operator cannot be used as a meaningful basis for 
the rationalizability notion. 

Example 4 To see this reconsider the game from Example 3. We first prove 
by induction that for n > we have Li?" = GR . 

The base case obviously holds. Denote the set {0, . . by Im- For the 
induction step note that if n = 2/c, then 

LR^^ = W = {M'\hM'\h). 

For any strategy m > k we have both 

Pi(m + 1, m) =771 + 1 > = pi{k + l,m) 

and 

pi(m + 1, -1) = m + l > k + 1 = pi{k + 1, -1). 

This shows that for each strategy i G Af' \ h of player 2 the strategy A; + 1 of 
player 1 is not a best response to i in LR^^ and consequently 

LR''^' = (AT' \ 4+1, AT' \ 4) = Gr'"^'. 

A similar argument applies when n = 2k + 1. 

Consequently LR"" = GR^ = ({-1}, {-1}). But for all Si, Sa G TVT' we have 
Pi(si, —1) > Pi(— 1, —1) = and P2(— 1) ■§2) > P2(— 1, —1) = —1- So for each 
player each strategy from M' is a best response to the (unique) strategy —1 of 
the other player in LR^ . Hence LR^"'^ = {M\M'). This shows that LR has 
no outcome. Also it is not monotonic and not even contracting. □ 
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Consequently, we confine our attention to its contracting version, the LR 
operator (defined by LR{G) := LR{G)r\G), that always has an outcome. Note 
for example that for the game from Example 3 we have LR = ({1},{1}) = 
LR^^^ , so ({— 1},{ — 1}) is the outcome of LR. This operator was introduced 
implicitly and for specific games, in Pearce [1984], in Definition 1 on page 
1032. 

Unfortunately, LR fails to satisfy any of the properties of GR listed in 
the GR Theorem 2. First, the largest fixpoint of LR does not need to exist. 
Indeed, let us return to the game from Example 3. For all a; G A/" U {— 1} 
the restriction {{x}, {x}) is a fixpoint of LR. However, their union, H, is not. 
Consequently, by Tarski's Fixpoint Theorem LR is not monotonic. 

Next, we exhibit a relaxation R of LR the outcome of which is different 
than the outcome of LR. 

Example 5 Consider a two-player game H in which the set of strategies for 
each player is the set A/" of natural numbers. The payoff to each player is 
the number (strategy) he selected. Take as the set of mixed strategies the 
probability distributions on A/" with a finite support (sometimes called simple 
probabilities). So when computing the payoffs to mixed strategies each of 
them can be written as ^^g^ 7i{i) ■ i, where A is a finite subset of M and tt is 
a probability distribution on A. (We shall return to this definition in Section 
10.) Take the belief structure in which the beliefs of each player is the set of 
so defined mixed strategies of the opponent. 

Clearly, no strategy is a best response to a mixed strategy of the opponent. 
So LR{H) = (0, 0) and (0, 0) is the outcome of LR. However, for any i > 
the restriction ({«}, {i}) is the outcome of a relaxation R of LR such that 
RiH) = m,{z}). □ 

This example shows that the rationalizability notion entailed by the LR 
operator is not order independent. In this example the outcome of a relaxation 
of LR is strictly larger than the outcome of LR. A more troublesome example 
is the following one in which the outcome of a relaxation of LR is strictly 
smaller than the outcome of LR. 

Example 6 We return here to Example 1 from Section 1. So is a game with 
two players, each with the set (0, 100] of strategies, and the payoff functions 
are defined by: 
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Pi(si,S2) := 



P2(Sl,S2) : = 



si(100- 




if 




< S2 


si(100- 


^i) 


if 


Si 


= S2 


2 









if 


Si 


> S2 


52(100- 


^2) 


if 


S2 


< Si 


52(100- 




if 




= S2 


2 




Si 







if 


S2 


> Si 



Also, we assume the pure belief structure. 

We noted already in Example 1 that LR{H) = ({50}, {50}) and 
X^(({50},{50})) = (({50},{50}))_ 

Take now the relaxation R of LR defined by: 

R(r\ =S ((^' 50], (0, 50]) ifG = H 
• \ LR{G) otherwise 

Then R{H) = (0, 50], (0, 50]) and i?(((0, 50], (0, 50])) = (0, 0) since 

Li?(((0, 50], (0, 50])) = (0,0). This shows that H cannot be reduced to an 
empty restriction by LR though it can by some relaxation of it. 

Finally, note that in this example also the LR operator exhibits an erratic 
behaviour. Indeed, LR{H) = ({50}, {50}), i.e., LR^ = ({50}, {50}). However, 
it is easy to see that (49,49) G Li?({50}, {50}), since pi(49,50) > pi(50,50) 
and P2(50, 49) > P2(50, 50). So LR^ is not a restriction of LR^. □ 

This example suggest that LR is unnecessarily weak. Also, it is counterin- 
tuitive that when LR is used to define rationalizability, in some natural games 
it is beneficial to eliminate at certain stages only some strategies that are never 
best responses. 

It is also easy to see that in Example 6 the outcome of the GR operator is 
an empty restriction. Indeed, GR{H) = ({50}, {50}) and GR{{{50}, {50})) = 
(0,0), since si = 49 is a better response in H to S2 = 50 than si = 50 and 
symmetrically for the second player. So GR is strictly stronger than LR in the 
sense that its outcome can be strictly smaller than that of LR. 

In this example the outcome of GR is the same as the outcome of a relax- 
ation of LR. However, this does not need to hold in general. In other words, 
GR defines a genuinely more powerful rationalizability notion that cannot be 
derived from LR. 
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Indeed, reconsider the game from Example 3. It is easy to see that the finite 
iterations of LR and GR coincide, so LR = ({ — !}, { — 1})- But ({ — !}, { — 1}) 
is a fixpoint of LR, so using LR we cannot reduce the initial game to an empty 
restriction. Moreover, the same holds for any relaxation R of LR. Indeed, it is 
easy to see that for each relaxation R of LR its outcome always contains the 
joint strategy (—1,-1). 



6 When the outcomes of GR and LR coincide 

To analyze the situations when the iterations of the GR and LR operators 
coincide we introduce the following property of the initial game H, given a 
belief structure {B, fi) in H. 

B For all beliefs fXi E Bi a. best response to /ij in H exists. 

The importance of this property stems from the fact that it allows us to 
equate during each iteration of the LR operator the best responses in the 
'current' game with the best responses in the initial game. 

For the finite games and all belief structures property B obviously holds 
but it can clearly fail for the infinite games. For instance, it does not hold 
in the game considered in Example 5 since in this game no strategy is a best 
response to a strategy of the opponent. Also it does not hold in the game from 
Example 3 but we now offer an example of a game in which property B does 
hold and in which the iterations of length > a; of both GR and LR are still 
unavoidable. 

Example 7 We modify the game from Example 3 by adding the third player 
and by removing the strategy —1 from the set of strategies of each player. 
So the set of strategies for each player is the set of natural numbers A/". The 
payoff functions are now defined as follows: 





P3{k,£,m) 



0. 



Further we assume the pure belief structure. Note that 



21 



• the best response to s_i = {£, m) is i + 1, 

• the best response to s_2 = {k, m) is k, 

• each m G A/" is a best response to s_3 = {k, i). 

So to each joint strategy of the opponents a best response exists. That is, 
property B is satisfied. Analogously to Example 3 we have: 

= (Ar,A/',Ar), 
G^' = (Ar\{0},Ar,Ar), 
GR' = {^\{0},^\{0},Ar), 
GR' = i^\{0,l},Ar\{0},^), 
G^ = {M\{0,1},M\{0,1},M), 

So GiT = (0,0, AT). Also aR((0,0^A/')) = (0,0,0), so GF^' = (0,0,0). 

Finally, it is easy to see that LR = GR for all a (this is in fact, a 
consequence of a result proved below), so u; + 1 is the closure ordinal of LR, 
as well. □ 

For infinite games a natural situation when property B holds is the fol- 
lowing. Recall that a game H = (Ti, . . ., T„,pi, . . .,p„) is called compact if 
the strategy sets are compact subsets of a complete metric space, and own- 
uppers emicontinuous if each payoff function pi is uppersemicontinuous in 
the zth argument. In turn, pi is called uppersemicontinuous in the ith 
argument if the set {s[ G Tj | Pi{s[, S-i) > r} is closed for all r G 7?. and all 

s-i G r_i. 

As explained in Dufwenberg and Stegeman [2002] (see the proof of Lemma 
on page 2012) for such games and pure belief structures property B holds by 
virtue of a standard result from topology. If we impose a stronger condition 
on the payoff functions, namely that each of them is continuous — the game 
is called then continuous — then we are within the framework considered in 
Bernheim [1984]. As shown there for compact and continuous games iterations 
of length > oj for the GR operator do not need to be considered, that is, its 
outcome (or equivalently the outcome of GR) can be reached in uj iterations. 
To put it more succinctly: acR < oj. 

In the presence of properties A and B still many differences between the 
operators GR and LR remain. In particular, LR does not need to be monotonic 
and its largest fixpoint does not need to exist. Indeed, consider the following 
example in which we consider a finite game, which ensures property B. 
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Example 8 Consider the game H := {A, A,pi,p2), where A = {1, . . .,n} and 
for i,j & A 

Piihj) ■= h 
P2{i,j) := 1. 

Assume the behef structure in which the behefs of each player is the set of the 
mixed strategies of the opponent, i.e., 81 = 82 = AA. 
Note that 

• r?, is the unique best response of player 1 to any belief //i G 81 about 
player 2, 

• each j E A is a best response of player 2 to any belief fX2 G 82 about 
player 1. 

So LR[H) = {{n},A) and {{n},A) is a fixpoint of LR. Also each restriction 
({j}) {]}) foi' j e A is a fixpoint of LR. However, their union, H, is not. 

Furthermore ({1}, {1}) C b_u^ {!}) = ({1},{1}) is not a re- 

striction of LR{H) = {{n},A), so LR is not monotonic. □ 

To prove the positive results we identify first the crucial property of the 
initial game H = (Ti, . . ., T„,pi, . . .,Pn) that holds in the presence of property 
B. 

Lemma 2 Assume property B. Then for all relaxations R of LR and all i G 
[l..n] 

Va V^i e8in R" \fsi G Ti (si G BRrc{^.;) ^ Si e BRnifii)), 

where := {Si, . . ., Sn)- 

In words, for all a and all beliefs in /ij G h i?" if Sj is a best response to 
fii in i?", then it is in fact a best response to /ij in H. 

Proof. Suppose Si G BRRa[ni), where /ij G i5j fi i?". The operator LR is 
contracting, so by the second condition in the definition of a relaxation for 
all (3 < a we have i?" C i?^. Therefore by property A for all /3 < a we have 
fii E 8i f] R'^ . In particular fii E 8i. 

By property B a best response s* to jji in H exists. But s* G BRnif^i) im- 
plies that for all P < a, s* G BR^pifii), so for all P < a, s* G TR{RI^) C RI^+^ 
(the inclusion holds since i? is a relaxation of LR). Moreover s* E RP = H 
and if s* G R^ for all successor ordinals (3 < a, then also s* G R^ for all limit 
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ordinals P < a. So s* is a strategy of player i in all restrictions for f3 < a, 
in particular Hence 

So Sj is also a best response to /ij in i^f. □ 

We prove now the following positive results under the assumption of prop- 
erty B. Part (i) shows that arbitrary iterations of the GR and LR operators 
coincide. Part (ii) establishes order independence of the operator LR. This is 
not an immediate consequence of part (i) since in general the relaxations of 
GR and LR differ. Finally, in part (Hi) we return to the LR operator that we 
considered and rejected in the previous section. 

Theorem 3 Assume properties A and B. 



(i) For all a we have GR = LR . In particular GR ''^ = LR . 

(ii) The LR operator is order independent. 

(Hi) For all a we have LR^ = LiC . In particular LR""^^ exists and LR""^^ 
Proof. 



(i) For all G we have GR{G) C LR{G), so in view of Lemma 1 we only need to 
prove for all a the inclusion LR C GR . We proceed by transfinite induction. 
Suppose that LR C GR . 

Q + l 

Let Si be a strategy of player i in LR . By definition for some /ij G 
Bi fi LR we have Sj G so by Lemma 2 Sj G BRff^^i). Further, 

LR"^^ C Li?", so by the induction hypothesis Si is a strategy of player i in 
GR"'. So Si is a strategy of player i in GlC^ . 

The induction step for a limit ordinal is immediate. 

{ii) Consider a relaxation R of LR that has an outcome, i?"^ is a fixpoint of 
i?, so R""^ is also a fixpoint of LR. Let Si be a strategy of player i in i?"^. 
By the definition of LR for some fXi & Bi f] R"^ we have Sj G BRjicn^fji), so 
by Lemma 2 Sj G BRuifii). Since Sj was arbitrary, this proves that i?"^ is a 
fixpoint of GR. Hence by Tarski's Fixpoint Theorem i?"^ C GR 



Moreover, by Lemma 1 GR C R'^R. Consequently R^R = GR 

{Hi) We proceed by transfinite induction. Suppose the claim holds for all 
P < a. To prove it for a + 1 we first we prove that LR"'^^ C LR". Let 
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be a strategy of player i in LR"~^^. Then for some /ij G i3j fi Li?" we have 

Si G BRijia{fii). By the induction hypothesis Li?" = LR , so by Lemma 2 

Si G BRnifii). 

Further, since LR is contracting, by property A for all < a we have 

fii G Bi n LR^ and hence by the induction hypothesis for all /3 < a we have 
fii E Bi n LR^. So Si is a strategy of player i in all restrictions LR^ for /3 < a, 
in particular Li?". Since Sj was arbitrary, this proves that LR"'^^ C Li?". 
Hence 

Li?"+i = Li?"+^ n Li?" = LR{LR'') = 

where the last equality holds by the induction hypothesis. 

The induction step for a limit ordinal is immediate. □ 

We mentioned already that property B is satisfied by the compact and 
continuous games and pure belief structures. So part (i) is closely related to 
the result of Ambroszkiewicz [1994] who showed that for such games the finite 
iterations of his versions of GR and Li? operators coincide for the limited case 
of two-player games and pure belief structures. In his definition both operators 
are defined by considering the reduction for each player in succession and not 
in parallel. 

In summary, by virtue of the results established in the last three sections, 
in the presence of property B, rationalizability can be equivalently defined 
using any of the introduced four operators GR, GR, LR and LR. However, 
when property B does not hold, only the first two operators are of interest. 



7 Strict dominance: the GS and GS operators 

Recall that one of the consequences of the assumption that all players are ra- 
tional is that none of them could possibly use any strictly dominated strategy. 
In this and the next section we apply our general approach to operators on 
games to establish analogous results for the notion strict dominance.^ In what 
follows we analyze four operators that can be naturally used to define iterated 
elimination of strictly dominated strategies. 

Given a restriction G := {Si, . . ., Sn) of H = (Ti, . . .,T„,pi, . . .,pn) and two 
strategies Sj, from Ti we write yc Si as an abbreviation for the statement 
Vs„j G S^i Pi{Si, S-i) > Pi{si,s^i) and say then that strictly dominates 
Si on G or, equivalently, that Sj is strictly dominated on G by s'^. 

^As is well-known there is an intimate connection between the notions of rationalizability 
and strict dominance. This, however, has no bearing on our results. We shall discuss this 
matter in Section 10. 
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First, we introduce the following operator GS (standing for 'global strict 
dominance') on the set of restrictions of H: 

GS{G) := {S[,...,S'J, 

where for all i G [l..n] 

S'^:={s,eT,\^3s[eT,s[ s.}. 

So GS{G) is obtained by removing from H all strategies that are strictly 
dominated on G by some strategy in H and not in G. The reasoning embodied 
in the definition of this operator is analogous to the one used for GR: we 
remove a strategy from if a 'better' (here: strictly dominating) strategy 
exists in the initial game H, even if in the iteration process leading from H to 
G this better strategy might have been removed. 

The GS operator was introduced in Milgrom and Roberts [1990], where 
only its iterations up to u were considered. As noted there this operator is 
clearly monotonic. So Note 1 applies and we can confine our considerations to 
the GS" operator (defined by GS{G) := GS{G)nG) that is also monotonic.^ On 
the account of the results of Section 3 this operator enjoys the same properties 
as the GR operator. We summarize them in the theorem below. 

Theorem 4 (GS) 

(i) The largest fixpoint of GS exists and is its outcome, 
(a) GS is order independent. 

(Hi) For all relaxations R of GS and all a we have GS^ C i?". □ 

The GS operator was introduced and analyzed in Chen, Long and Luo 
[2005] , where the need for transfinite iterations was explained and where prop- 
erties (i) and (ii) were proved. 



8 Strict dominance: the LS and LS operators 

The customary definition of the iterated elimination of strictly dominated 
strategies (lESDS) involves elimination of strategies that are strictly domi- 
nated by a strategy from the currently considered game and not the initial 

^The reader may now notice that in Example 2 we used the GS operator instead of GS, 
which is more comphcated to justify informally. 
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game H. A natural operator that formalizes this idea is the following one {LS 
stands for 'local strict dominance'): 

LS{G) ■.= {S[,...,S'J, 
where G := {Si, . . ., Sn) and for all i G [l..n] 

So here, in contrast to GS, a strategy is removed if it is strictly dominated 
on G by some strategy in G itself. However, the LS operator is not acceptable 
for the same reason as the previously considered LR operator. 

Example 9 Reconsider the two-player game H from Example 5 in which the 
set of strategies for each player is the set of natural numbers. The payoff to 
each player is the number he selected. In this game each strategy is strictly 
dominated. 

So LS{H) = (0, 0). But L5((0, 0)) = i/, since the condition ^3s^ E Sis'^ 
Si is vacuously satisfied when S'j = 0. So the iterations of LS oscillate between 
H and (0, 0). Hence the outcome of LS does not exist. 

A fortiori LS is not monotonic and not contracting. The most problematic 
is of course that this operator yields a non-empty restriction (in fact, the initial 
game) when applied to an empty restriction. □ 

So, as in the case of the LR operator, we confine our attention to the 
contracting version LS (defined by LS{G) := LS{G) fl G). In fact, in the 
literature the LS operator was not considered but rather LS. However, LS 
fails to be monotonic, even for finite games. Indeed, the game from Example 
8 provides the evidence. 

The LS operator was shown to be order independent for finite games in 
Gilboa, Kalai and Zemel [1990]. It was studied for infinite games in Dufwen- 
berg and Stegeman [2002] where it was noted that it fails to be order inde- 
pendent for arbitrary games. This is immediate to see using the game from 
Examples 5 and 9. Indeed, the outcome of LS is then (0,0), whereas for any 
i > the restriction {{i}, {i}) is the outcome of a relaxation R of LS such that 
R{H) = {{^},{^}). 

In the remainder of this section we prove a limited form of order indepen- 
dence of LS. Then, in the next section, we compare our results with those 
of Dufwenberg and Stegeman [2002]. First, following Dufwenberg and Stege- 
man [2002], we consider the following property of the initial game H: 
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P For all relaxations R of LS and all k > 0, every strictly dominated strategy 
in i?^ has an undominated ('best') dominator. 

This property limited to the initial game (so for k = 0) was considered in 
Milgrom and Roberts [1996]. We generalize this property to all ordinals and 
formalize it as follows: 

C(a) For all relaxations R of LS and all i G [l..n] 

3s* e T, {s* A -3s: e T, s[ s*)). 

Note that all the quantifiers range over Tj and not Si. So we refer to 
strict dominance by a strategy in the initial game H and not in the currently 
considered reduction i?". In what follows we shall rather use the following 
simpler property: 

D(q;) For all relaxations R of LS and all i G [l..n] 

Vsi G Ti{{3s'i G s'i yR<. Si) 3s* G Si s* Sj), 
where R" := (S'i, . . ., S'„). 

It states that each Sj strictly dominated in i?" is in fact strictly dominated 
in R°' by some strategy in R°'. 

First we establish a lemma that clarifies the relation between these two 
properties. 

Lemma 3 For each a, C(a) implies D(a). 

Proof. Consider a relaxation R of LS, some i G [l..n]. Let i?" := (S'i, . . ., S'„). 
Suppose Si G Tj and s^ G Tj are such that s^ ^^r^ Sj. By property C(a) 

3s* G Ti (s* Si A -3s: e >-R^ s*)- 

LS is contracting so for /5 < a we have i?" C Rf^ and consequently V/3 < 
a -^3s[ G Tj s'i y-Rp s*. Hence s* is a strategy of player i in all restrictions i?^ 
for (3 < a. In particular s* G S'i. □ 

Consequently all the results that follow also hold when property C{a) is 
used instead of D(a). 

We now establish a number of consequences of property D(q;) for various 
values of a. Part (i) is a counterpart of Theorem 3(z). Part (n) is a limited 
order independence result for the LS operator. Finally, in part [Hi) we compare 
the operators LS and LS and establish an analogue of Theorem 3{iii). 
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Theorem 5 



(i) Assume property \/j3 < aD(j3) for an ordinal a. Then = . In 
particular, if\/aD(a), then G^'^^ = L^^^ . 

(a) Assume property \/aD(a). Then the LS operator is order independent. 

(Hi) Assume property V/9 < a + 1 D(j3). Then LS" = . In particular, if 
\/aD(a), then LS""' exists and LS""' = . 

Proof. 

(i) In view of Lemma 1 we only need to prove the inclusion C G^ and 
only the induction step for a successor ordinal requires a justification. So 
suppose that V/3 < a + 1 D(/?). Let LS^ := (5*1, . . ., S'„). 

Let Si be a strategy of player i in L^^^ . By definition Sj G Si and -i3s^ G 
Si s[ >~i^ Si, so by the assumed property ~i3s- G Tj s[ >^xs" ^i- Hence 
-i3s^ G TjS^ )^7j5" Sj, since by the induction hypothesis C G^ . Also, 
because of the same inclusion, Si is a strategy of player i in bo Sj IS a 

strategy of player i in GS'^ . 

(iz) The proof is similar to that of Theorem 3{ii). Consider a relaxation R of 
LS that has an outcome, i?"^ is a fixpoint of i?, so i?"^ is also a fixpoint of 

Is. 

Suppose now i?"^ := (^i, . . ., Sn) and take some Si G Si. By the definition 
of LS we have ~i3s* G S'j s* ;^_RQfl Si, so by property D(Q;ij) we get ~i3s^ G 
s'i y-R'^R Si. Since Sj was arbitrary, this proves that R""^ is a fixpoint of GS. 
Hence by Tarski's Fixpoint Theorem i?"^ C CS^'^'^. 

Moreover ,Jor all G we have both G5(G') C l5(G)_and LS{G) C i?(G'), so 
by Lemma 1 G^^ C i^'^fl and consequently = GS^^. 

(Hi) We prove the claim by transfinite induction. Assume it holds for all 
j3 < a. We prove it for a + 1. So suppose that V/3 < a + 2 D(/9). Let 
LS" := {Si, . . ., Sn). Let Sj be a strategy of player i in LS"^^. By definition 

By the induction hypothesis LS" = LS" , so by the assumed property 
-i3s' G Tj s'^ yjjg^ Si. So Sj is a strategy of player i in GS{LS ). But by part 
{i)TT =~GT and = of . Also, since GS is monotonic, by Note 1 

GS" = GS" and GS^^^ = GS"+\ So 

G5(XS^) = G5(GS^) = GS"+^ = XS^^\ 
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Since Si was arbitrary, this shows that LS°''^^ C L^~^ . But also 

TT^^ = LS{LS") = LS^+^ n LS" C LS^+\ 

where the first equality holds by the induction hypothesis. So LS^"*"^ 
The induction step for a limit ordinal is immediate. 

Property VaC(a) obviously holds when the initial game is finite and implies 
by Lemma 3 property \/a'D{a), so part (ii) generalizes the already mentioned 
result of Gilboa, Kalai and Zemel [1990]. Further, note that in the proof of 
part (i) we actually use a weaker property than \/(3 < aD(/?). Indeed, we use 
it only with R equal to LS, so it suffices to assume that for all (3 < a 

Wsi e Ti{(3s'- e Ti s- yj-g3 Si) 3s* G 5"^ s* Sj), 

where 

— (5*1, . . ., Sn). 

In summary, the iterations of two operators, GS and GS, always coincide 
and each of them is order independent. Further, when VaD(a) holds, all 
iterations of all four operators, GS, GS, LS and LS, coincide and any of them 
can be used to define the outcome of lESDS. The property VaD(a) holds 
when the initial game is finite, so to conclude this section let us summarize 
the consequences of the above result for this case. 

Corollary 1 Suppose the initial game H is finite. Then 

(i) for all k > the iterations of all four operators coincide, i.e., 

GS^ =~G^ =T^ = L^, 

(ii) the outcomes of these four operators exist and coincide, 
(Hi) the operators GS, GS and LS are order independent. □ 

9 Comparison with the results of Dufwenberg 
and Stegeman 

We now compare the results of the previous section with those of Dufwenberg 
and Stegeman [2002]. First, we introduce the following notion. We say that 



□ 
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G is an u -outcome of an operator T on the set of restrictions of if if G is an 
outcome of T and ut < 

That is, G is an a;-outcome of T if G = T'^ and T"^+i = . For a 
contracting operator, in contrast to the outcome, an w-outcome does not need 
to exist. The study of Dufwenberg and Stegeman [2002] focuses on the set 

uj{L3) := {G I G is an u;-outcome of a relaxation of LS}. 

If this set has at most one element, then they view LS as order independent. 
In what follows we refer then to DS- order independence. Recall that 
according to our definition an operator T is order independent if the set 

{G I G is an outcome of a relaxation of T} 

has at most one element. We can then state the main results of Dufwenberg 
and Stegeman [2002] as follows. To clarify part (z) recall that by definition a 
restriction (5*1, . . ., Sn) is a game if each Si is non-empty. 

Theorem 6 

(i) If H is compact and own-uppers emicontinuous and the set lj(LS) has an 
element which is a game, then this is its only element. 

(a) If H is compact and continuous, then the set uj{LS) has precisely one 
element and this element is a compact and continuous game. □ 

Dufwenberg and Stegeman [2002] considered property P from the previous 
section but formalized it as VA; < uE^k), where for an ordinal a we have: 

E(a) For all relaxations R of LS and all i G [l..n] 

Wsi G Si (3s. G Si s'i Si 

3s* G Si (s* s, A -^3s[ G Si s[ y-Rc s*)), 

where i?" := {Si, . . ., Sn). 

They showed that property \fk < a;E(fc) is satisfied by the compact and 
own-uppersemicontinuous games but is not a sufficient condition for DS-order 
independence of LS. Note that the difference between the properties C{a) and 
E(a) is that in the former all the quantifiers range over Tj and not Si. So in 

^In Dufwenberg and Stegeman [2002] an cj-outcomc is called a maximal ( ^*)- 
reduction. 
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C(a) we refer to strict dominance by a strategy in the initial game while in 
E(q;) to strict dominance by a strategy in the currently considered reduction 

The following result then relates property D(a) (and hence by Lemma 3 
property C(q;)) to DS-order independence of LS. 

Theorem 7 Assume property D(uj). Thenuj{LS) C {XS*^}, so LS is DS-order 
independent. 

Proof. Let i? be a relaxation of LS such that < u. For all a we have both 
C TSiR") and TS{R^) C so by Lemma 1 

'G^<ZW. (1) 

Let := {Si, . . .,Sn)- Take a strategy Sj G Si. is a fixpoint of R, 
so it is a fixpoint of LS". Hence ~i3s^ G 5*^ >-iji^ Si, so by property 0(0;) 
-i3s^ G Tj Si. Since Sj was arbitrary, this shows that R'^ is a fixpoint of 

05. So by the VS Theorem 4(i) we have R"^ C ^. Also, 'GS is contracting, 
so GS^^ C GS^ and hence 

This inclusion combined with (1) yields R'^ = GS^ . By Theorem 5(z) i?'^ = 
L^. _ _ 

So we showed that any u;-outcome of a relaxation of LS equals L^ . This 
concludes the proof. □ 

Dufwenberg and Stegeman [2002] also showed that for compact and own- 
uppersemicontinuous games property Wk < u!'D{k) holds. So the above theo- 
rem is a minor improvement of the result of Dufwenberg and Stegeman [2002] 
listed earlier as Theorem Q{i). Finally, note that when V/c < ci;D(A;) holds, 
then by Theorem 5(z) and (iii) the first u iterations of all four operators, 
GS, GS, LS and LS, coincide. So in particular this is the case for the compact 
and own-uppersemicontinuous games. 

10 Strict dominance by a mixed strategy 

It is well-known that the notions of strict dominance and best responses, and 
consequently the notions of iterated elimination of strictly dominated strate- 
gies and of rationalizability, are closely related. In this context one usually 
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considers strict dominance by a mixed strategy. In section we review this re- 
lationship and clarify to what extent the results of the previous three sections 
can be extended to mixed strategies. 

In Moulin [1984] the class of so-called nice games is introduced for which 
the notions of a best response to a point belief (i.e., a joint pure strategy 
of the opponents) and of not being weakly dominated by a pure strategy 
coincide. These are games (Ti, . . ., T„,pi, . . .,Pn) in which each strategy set Tj 
is a compact and convex subset of TZ and each payoff function pi is continuous 
and strictly quasiconcave w.r.t. Tj, where the latter means that for all 
q; G (0, 1) and Si^s[ G Ti with ^ s[ and all s_j G T_j 

Pi{si, s-i) > pi{s[, s-i) implies Pi{asi + (1 - a)s[, s_i) > 

In Zimper [2006] it is clarified that for nice games the notions of weak dom- 
inance and strict dominance coincide. This yields for nice games equivalence 
between the notions of a best response and of not being strictly dominated, 
both w.r.t. pure strategies. This result is then generalized by assuming in- 
stead of strict quasiconcativity that each payoff function pi is quasiconcave 
w.r.t. Ti, which means that for all a G (0, 1) and Sj, s'i G Ti with Si ^ s'^ and 
all s_i G T_i 

Pi{si, s_i) > pi{s'i, implies Pi{aSi + (1 - a)s'i, > Pi{s'i, s_i) 

and 

Pi{si, s_i) = pi{s'i, s_i) implies Pi{aSi + {I - s_i) > Pi{s'i, s_i). 

It is also shown that the equivalence does not need to hold anymore if the 
strategy sets Tj are subsets of 71^ instead of 71. 

In the case of finite games the notion of strict dominance extends in the 
obvious to the case of mixed strategies. By the result of Pearce [1984] in two- 
player finite games the notions of a best response to a mixed strategy of the 
opponent and of not being strictly dominated by a mixed strategy coincide. 
In Osborne and Rubinstein [1994] this result is presented as a result for n- 
players finite games where the best response is defined w.r.t. correlated mixed 
strategies. More recently, in Zimper [2005], both results were generalized to 
compact games with bounded and continuous payoff functions. 

In an arbitrary game (Ti, . . .,Tn,pi, . . .,Pn) the set of mixed strategies AT] 
of player i is defined as the set of all probability measures on a given a-algebra 
of subsets of Ti. In the case of compact games with continuous payoff functions 
it is customary (as in Zimper [2005]) to take the a-algebra of Borel sets. The 
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payoff functions are then extended from pure to mixed strategies in a standard 
way using integration. To ensure that the payoffs remain finite the original 
payoff functions are assumed to be bounded. 

If the payoff functions are unbounded, an alternative (used in Example 5) 
is to define mixed strategies as the probability measures with a finite support. 
More general approaches for two-player games are studied in Tijs [1975]. 

In what follows we just assume that given the initial game (Ti,...,r„, 
Pi, . . .,Pn) for each z G [l..n] a set ATj D Tj of mixed strategies of player i is 
given and that each payoff function pi is extended to pi : ATi x . . . x AT„ — > 71. 
If the initial game is finite, we take the usual set of mixed strategies and the 
customary extension of each payoff function. 

Then the results of Section 8 can be directly adapted to the case of strict 
dominance by a mixed strategy as follows. First, we introduce the counterpart 
of the LS operator defined by: 

MLS{G) := iS[,...,S'J, 
where G := {Si, . . ., S'„) and for all i G [l..n] 

S'i := {si G Ti I -^3mi G ASi nii >~g Si}, 

where we use the extension of the relation to the pairs of mixed and pure 
strategies. 

In the literature, in the case of finite games, the iterated elimination of 
strategies that are strictly dominated by a mixed strategy is defined as the 
iteration of MLS, the contracting version of the above operator. The obvious 
modification of the GS operator to the mixed strategies is defined by: 

MGSiG) :=iS[,...,S'J, 

where for all i G [l..n] 

S'i := {si G Ti I -<3mi G ATi rrii ^g Si}. 

Just as GS, the MGS operator is clearly monotonic. Its contracting ver- 
sion, MGS, is studied in Brandenburger, Friedenberg and Keisler [2006] (it is 
their map where its relation to the concept of best response sets is clarified. 

Next, we modify the property D(a) to the case of mixed strategies: 

MD(a) For all relaxations R of MLS and all i G [l..n] 

Vsi G Ti{{3mi G ATi m >~rc. Si) 3m* G ASi m* y-Rc Si), 
where R"" := {Si, . . ., S'„). 
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Then we have the following direct counterpart of Theorem 5. 
Theorem 8 

(i) Assume property'^ j3 < aMD((3) for an ordinal a. Then MG^ = ML^ . 
In particular, if\/aMD(a), then WgT^ = JdlT™^' . 

(ii) Assume property \/aMD(a). Then the MLS operator is order indepen- 
dent. 

(Hi) Assume property Wf3 < a + 1 MD([3). Then MLS" = ML^ . In partic- 
ular, if^aMD(a), then MLS"*'"' exists and MLS"«" = MLS"^. 

Proof. Analogous to the proof of Theorem 5 and omitted. □ 

Consequently, when VaMD(a) all iterations of all four operators, MGS, 
MGS, MLS and MLS, coincide. To establish this result, as in the case of strict 
dominance by a pure strategy, it is sufficient to use property MD(a) with R 
equal to MLS. 

The question remains for which games property MD(a) holds. We found 
(the details are relegated to another paper) that in the case of finite games 
and the customary set of mixed strategies, property MD(A;) holds for all k > 
0. Since the closure ordinals of the above four operators are then finite, we 
conclude by the above theorem that all iterations of the above four operators 
then coincide. 



11 Concluding remarks 

In this paper we analyzed two widely used ways of reducing strategic games 
concerned with the concepts of rationalizability and iterated elimination of 
strictly dominated strategies. We showed that both concepts can be defined in 
a number of ways that differ for arbitrary infinite games. Also, we clarified for 
which games these differences disappear. Our analysis was based on a general 
study of operators on complete lattices and showed that concepts defined by 
means of monotonic operators are easier to assess and study. 

In some circumstances a reduction notion defined using a non-monotonic 
operator still can be analyzed using our approach, by relating the operator to a 
monotonic one. This is for example how we established the order independence 
of the LS operator under the assumption \/aD{a) — by relating it to the GS 
operator which is monotonic. 



35 



An important aspect of our analysis is that we allow transfinite iterations 
of the corresponding operators. Their use in an analysis of reasoning used 
by rational agents can be baffling. These matters were originally discussed 
in Lipman [1991], where a need for transfinite iterations in the definition of 
rationalizability was noted. The distinction between finitary and infinitistic 
forms of reasoning is well understood in mathematical logic. Both forms have 
been widely used and we see no reason for limiting the study of games to 
finitary methods. 

The final matter that merits attention is the striking difference between the 
way rationalizability and iterated elimination of strictly dominated strategies 
(lESDS) have been traditionally defined and used in the literature. Both 
concepts are supposed to capture reasoning used by rational players. Yet, 
in the definition of the former concept, according to Bernheim [1984], the 
reference point for a deletion of a strategy is the initial game, while in the 
definition of the latter one the currently considered game. This difference is 
important, since the first approach yields a monotonic operator, while the 
second one not. 

Acknowledgements 

We thank Xiao Luo for an interesting discussion on the subject of Apt [2005] 
and Chen, Long and Luo [2005], references to Milgrom and Roberts [1990] 
and Ritzberger [2001], and helpful suggestions. Adam Brandenburger helped 
us in assessing and framing the relevant results. Also, we thank the referees 
of earlier versions of this paper for useful comments. In particular, one of the 
referees of Apt [2005] drew our attention to the paper Ambroszkiewicz [1994]. 
Another referee spotted an error in one of our examples. Finally, one of the 
referees of this submission provided most helpful, extensive, comments and 
suggested Section 10. 

References 

p. ACZEL 

[1977] An introduction to inductive definitions, in: Handbook of Mathematical Logic, 
J. Barwise, ed., North-Holland, pp. 739-782. 

S. Ambroszkiewicz 

[1994] Knowledge and best responses in games, Annals of Operations Research, 51, 
pp. 63-71. 



36 



K. R. Apt 

[2005] Order independence and rationalizability. in: Proc. 10th Conference on Theo- 
retical Aspects of Reasoning about Knowledge (TARK), Singapore, pp. 22-38. 
Available from http : //portal . acm . org. 

R. AUMANN 

[1985] What is game theory trying to accomplish?, in: Frontiers of Economics, K. Arrow 
and S. Honkapohja, eds., Basil Blackwell, pp. 28-76. 

B. D. Bernheim 

[1984] Rationalizable strategic behavior, Econometrica, 52, pp. 1007-1028. 

K. BiNMORE 

[1991] Fun and Games: A Text on Game Theory, D.C. Heath. 

[2007] Playing for Real: A Text on Game Theory, Oxford University Press, Oxford. 

A. Brandenburger and E. Dekel 
[1987] Rationalizability and correlated equilibria, Econometrica, 55, pp. 1391-1402. 

A. Brandenburger, A. Friedenberg, and H. Keisler 
[2006] Fixed points for strong and weak dominance. Working paper. Available from 
http : //pages . stern. njni. edu/~abranden/. 

Y.-C. Chen, N. V. Long, and X. Luo 

[2005] Iterated strict dominance in general games. Available from http : //www . sinica. 
edu . tw/~xluo/palO . pdf . 

M. Dufwenberg and M. Stegeman 
[2002] Existence and uniqueness of maximal reductions under iterated strict dominance, 
Econometrica, 70, pp. 2007-2023. 

I. GiLBOA, E. Kalai, and E. Zemel 
[1990] On the order of eliminating dominated strategies. Operation Research Letters, 9, 
pp. 85-89. 

A. Heifetz and D. Samet 

[1998] Knowledge spaces with arbitrarily high rank. Games and Economic Behavior, 22, 
pp. 260-273. 

P. J. -J. Herings and v. J. Vannetelbosch 
[2000] The equivalence of the Dekel-Fudenberg iterative procedure and weakly perfect 
rationalizability. Economic Theory, pp. 677-687. 

B. Kn ASTER 

[1928] Un theoreme sur les fonctions d'ensembles, Annales de la Societe Polonaise de 
Mathematique, 6, pp. 133-134. 

B. L. LiPMAN 

[1991] How to decide how to decide how to . . . : Modeling limited rationality, Econo- 
metrica, 59, pp. 1105-1125. 

[1994] A note on the implications of common knowledge of rationality. Games and Eco- 
nomic Behavior, 6, pp. 114-129. 

P. MiLGROM AND J. ROBERTS 

[1990] Rationalizability, learning, and equilibrium in games with strategic complemen- 
tarities, Econometrica, 58, pp. 1255-1278. 



37 



[1996] Coalition-proofness and correlation with arbitrary communication possibilities, 
Games and Economic Behavior^ 17, pp. 113-128. 

H. Moulin 

[1984] Dominance solvability and cournot stability, Mathematical Social Sciences, 7, 
pp. 83-102. 

M.J. Osborne and A. Rubinstein 
[1994] A Course in Game Theory, The MIT Press, Cambridge, Massachusetts. 

D. G. Pearce 

[1984] RationaHzable strategic behavior and the problem of perfection, Econometrica, 
52, pp. 1029-1050. 

K. RiTZBERGER 

[2001] Foundations of Non-cooperative Game Theory, Oxford University Press, Oxford. 
A. Tarski 

[1955] A lattice-theoretic fixpoint theorem and its applications. Pacific J. Math, 5, 
pp. 285-309. 

S. TiJS 

[1975] Semi-infinite and infinite matrix games and bimatric games, PhD thesis, 
Katholieke Universiteit Nijmegen. 

A. ZiMPER 

[2005] Equivalence between best responses and undominated strategies: a generalization 
from finite to compact strategy sets. Economics Bulletin, 3, pp. 1-6. 

[2006] A note on the equivalence of rationalizability concepts in generalized nice games. 
International Game Theory Review, 8, pp. 669-674. 



38 



